18.05 Lecture 16 
March 14, 2005 

Expectation of a random variable. 

X - random variable 

roll a die - average value = 3.5 

flip a coin - average value = 0.5 if heads = and tails = 1 

Definition: If X is discrete, p.f. f(x) = p.f. of X, 
Then, expectation of X is EX = J2 x fi x ) 
For a die: 
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E = 1 x ± + ... + 6 x i = 3.5 



Another way to think about it: 



Consider each pi as a weight on a horizontal bar. 
Expectation = center of gravity on the bar. 

If X - continuous, f(x) = p.d.f. then E(X) = J xf(x)dx 
Example: X - uniform on [0, 1], E(X) = f*(x x l)dx = 1/2 



Consider Y = r(x), then EY = ^2 x r(x)f(x) or J r(x)f(x)dx 

p.f. g(y) = 52{x:y=r(x)} t ' ( X ) 

= Ey V9{y) =T, y y H{ X :y=r(x)} f( X ) = T, y Y, {x :r{x)= V } Vf( X ) = E y Y, {x :r{x)= V } r { x )f( x ) 



Example: X - uniform on [0, 1] 
EX 2 = J^X 2 x Idx = 1/3 

Xi, ...,X n - random variables with joint p.f. or p.d.f. f(x\...x n ) 
E(r(Xi, ...,X n )) = J r(xi, ...,x n )f(xi, ...,x n )dxi...dx n 

Example: Cauchy distribution 
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p.d.f: 
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Check validity of integration: 




But, the expectation is undefined: 



48 



Note: Expectation of X is defined if E|X| < oo 
Properties of Expectation: 

1) E(aY + b) = aE(X) + b 

Proof: E(aY + b) = J(aX + b)f(x)dx = aj xf(x)dx + b J f(x)dx = aE(X) + b 

2) E(X 1 +X 2 + ... + X n ) = EXi + EX 2 + ... + EX n 
Proof: E(Xi + X 2 ) = J J(xi + x 2 )f(xi, x 2 )dx 1 dx 2 = 
= J J x 1 f(x 1 ,x 2 )dx 1 dx 2 + J J x 2 f(x l7 x 2 )dxidx 2 = 
= J xi J f(xi,x 2 )dx 2 dxi + J x 2 J f(xi,x 2 )dxidx 2 = 
= J xifi{xi)dxi + J x 2 f 2 (x 2 )dx 2 = EXx + EX 2 

Example: Toss a coin n times, "T" on i: Xi = 1; "H" on i: Xi = 0. 
Number of tails = X x + X 2 + ... + X n 

E(numbcr of tails) = E(X X + X 2 + ... + X n ) = EXi + EX 2 + ... + EX n 
EX, = 1 x F(Xi = 1) + x F(Xi =0)=p, probability of tails 
Expectation = p + p + ... + p = np 

This is natural, because you expect np of n for p probability. 

Y = Number of tails, F(Y = k) = (f)p k {l - p) n ~ k 

nY) = E n k= oH n k )p k ( 1 -pr- k = n p 

More difficult to see though definition, better to use sum of expectations method. 

Two functions, h and g, such that h(x) < g(x), for all x e M 
Then, E(h(X)) < E(g(X)) -» E(g(X) - h{X)) > 
J(g(x) - h{x)) x f(x)dx > 

You know that f(x) > 0, therefore g(x) — h(x) must also be > 
If a<X <b-> a< E{X) < E(b) < b 

E(I(X e A)) = 1 x F(X e A) + x F(X <£ A), for A being a set on M 

Y = I(X e A) = {1, with probability F(X e A);0, with probability F(X <£ A) = 1 - F(X e A) 
E(I(X e A)) = F(X e A)} 

In this case, think of the expectation as an indicator as to whether the event happens. 

Chebyshev's Inequality 

Suppose that X > 0, consider t > 0, then: 

V{X >t)< -E(X) 

Proof: E(X) = E(X)I(X < t) + E{X)I{X >t)> E{X)I{X >t)> E(t)I(X >t)= tF(X > t) 
** End of Lecture 16 
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